Title: Tangible User Interface for Learning Language Skills in Augmented Reality
In the given paper, the authors discuss the usefulness of Tangible User Interface (TUI) for acquiring language skills, such as reading and writing. TUI allows users to manipulate physical objects to create words and sentences in a spatial environment.
The authors propose the development of a TUI application using Augmented Reality (AR) to help children learn how to construct sentences. They note that there are few past examples that focus specifically on sentence construction.
The design goals for the application are as follows:
- Use inexpensive and existing tools.
- Use colors to represent grammar.
- Use touchable characters to learn sentence structure.
- Provide multimodal feedback, including animations, sounds, and text.
The application allows users to create sentences using blocks. When the user scans the blocks with the AR system, an animation is displayed if the sentence is correct. If the sentence is incorrect, the system provides correction hints.
The authors highlight that the application is designed to be easily assembled using readily available parts such as LEGO.
In their reflections, the authors mention the concept of Design Goals and express their interest in further exploring it. They also compare their definition of TUI with the definition proposed by the paper “Tangible Bits - New user interface design that integrates information and the physical world”. They note that their application does not achieve the same level of alignment between input and output spaces.
They also mention another paper, “Dueto: Accessible, Gaze-Operated Musical Expression”, which explores multimodal input, similar to their application’s output. They question whether the term “multimodal” is commonly used and if it applies to both input and output scenarios.